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DESCRIPTION 



IMAGE PROCESSING DE 




Technical Field 

The present invention relates to an image processing device and, more particularly, 
to an image processing device which enhances contrast for medium-to-fine details (a 
catheter, blood vessels, etc.) of an image by compressing low-frequency components of 
the image collected by a measurement section of an image diagnosis apparatus or the 
like. 

Background Art 

On medical images obtained by conventional X-ray image diagnosis apparatuses 
or the like, dynamic range compression processing (DRC processing) is performed to 
enhance contrast at a guide wire, a catheter, a blood vessel, etc. DRC processing is 
processing for compressing low-frequency components of an input image. 

For extraction of low-frequency components in DRC processing, a method 
(Japanese Patent Application Laid-open No. 9-182093) which uses an infinite impulse 
response (HR) filter (also called a recursive filter) is known. 

The recursive filter is a feedback-type filter which performs present smoothing 
processing by using the results of preceding smoothing processing, and which is capable 
of efficiently extracting low-frequency components by a smaller amount of computation 
in comparison with FIR filters. 

A top-bottom/left-right recursive filter performs recursive filtering processing by 
reciprocating along top-bottom and left-right directions with respect to the direction of 
scanning on an input image, i.e., four cycles of recursive filtering processing in total, to 
obtain an unsharpened image free from phase distortion (Japanese Patent Application 
Laid-open No. 9- 1 82093). 

The conventional recursive filter performing recursive filtering on an input image 
by reciprocating along top-bottom and left-right directions, i.e., four cycles of recursive 
filtering processing in total, requires at least a time for input of one frame of image data 
in obtaining an output value for a particular one of pixels. Thus, DRC processing using 
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a top-bottom/left-right recursive filter is not suitable for real-time processing because of 
a large delay due to image processing. 

An object of the present invention is to provide an image processing device 
having only a short delay due to image processing and a small amount of computation, 
5 free from an artifact such as black region in a processed image, and capable of largely 
improving contrast for a medium-to-fine detail of an image such as a catheter. 

Disclosure of the Invention 

To achieve the above-described object, the present invention provides an image 
processing device comprising recursive filtering means of smoothing an input image and 

10 arithmetic means of subtracting an input image smoothed by the recursive filtering 
means from the original of the input image, wherein the recursive filtering means 
includes edge setting means of setting at least one edge having a predetermined angle 
from a scanning line direction of the input image, and control means of smoothing the 
image to be smoothed in correspondence with the edge set by the edge setting means. 

15 That is, the control means controls the recursive filter so that the recursive filter 

outputs a smoothed image (unsharpened image, i.e., low-frequency components) 
smoothed in an edge direction set as the direction of an edge of the input image (e.g., a 
direction perpendicular to the line of scanning on the image). The low-frequency 
components are compressed into a suitable amount by low-frequency component 

20 compression amount setting means and thereafter output. Low-frequency component 
compression means compresses the low-frequency components of the input image by 
subtracting from the input image the output value from the low-frequency component 
compression amount setting means. The recursive filter can extract the low-frequency 
components of the input image with an input time delay corresponding to one line of the 

25 input image. Therefore, DRC processing has only a short delay due to image 

processing and is capable of real-time processing by a small amount of computation. 

Also, in the recursive filter, the feedback rate is changed according to the 
magnitude of the value of the difference between the input image and the output image 
one-line before. For example, if the absolute value of the difference value is smaller, 

30 the degree of smoothing is increased. If the absolute value of the difference value is 
larger, the degree of smoothing is reduced. In this way, the influence of phase 
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distortion (an artifact such as a black region due to DRC processing on a falling 
low-luminance portion of the input image in particular) is prevented and contrast at a 
medium-to-fine detail of the image such as a catheter is improved. 

Phase distortion can be further reduced by providing a plurality of recursive filters 
5 which output unsharpened images smoothed on the basis of edges in a plurality of 
directions, and by combining outputs from the recursive filters. 

Brief Description of the Drawings 

Figure 1 is an essential-portion block diagram showing an embodiment of an 
image processing device in accordance with the present invention; 
10 Figure 2 is a block diagram showing an example of a configuration of the 

recursive filter shown in Figure 1 ; 

Figure 3 is a graph showing input-output characteristic of the LUT shown in 
Figure 1; 

Figure 4 is an essential-portion block diagram showing another embodiment of the 
15 image processing device in accordance with the present invention; 

Figure 5 is a block diagram showing an example of a configuration of the 
recursive filter shown in Figure 4; 

Figure 6 is a diagram used for explanation of the effect of the present invention 
(limitation of black region in an edge neighborhood region); and 
20 Figure 7 is a diagram used for explanation of the effect of the present invention 

(an improvement in contrast at a catheter). 

Best Mode for Carrying Out the Invention 

Preferred embodiments of the present invention will be described in detail with 
reference to the accompanying drawings. 
25 Figure 1 is an essential-portion block diagram showing an embodiment of an 

image processing device in accordance with the present invention. 

As shown in Figure 1, an image processing device 10 is constituted by an edge 
preservation type of recursive filter 12, a lookup table (LUT) 14, a delay circuit 16, and 
an arithmetic unit 18. "Edge" referred to herein denotes a portion of an image at which 
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the difference between the values of adjacent pixels in data on one line of the image is 
large. 

An input image in the image processing device 10 is, in the case of a medical 
image diagnosis apparatus such as an X-ray imaging apparatus for example, a digital 
5 image measured in an X-ray image measurement section including an image intensifier 
and a CCD camera or an X-ray flat panel detector or the like. For example, the digital 
image is a fluoroscopic image continuously collected as a moving image of 1024 x 1024 
pixels, 4096-step gradation, and 30 frames/second. The digital image may alternatively 
be an image collected in real time by an ultrasonic diagnosis apparatus. 

10 The above-described input image is input to the edge-preservation-type recursive 

filter 12 and the delay circuit 16 of the image processing device 10. 

The edge-preservation-type recursive filter 12 will next be described. The 
edge-preservation-type recursive filter 12 represents recursive filtering processing 
performed in a direction in which its edge is set or preserved. 

15 Figure 2 is a block diagram showing an example of a configuration of the 

above-described edge-preservation-type recursive filter 12. The edge-preservation-type 
recursive filter 12 is constituted by line memories 120 and 128, an arithmetic unit 122, a 
LUT (LookUp Table) 124 and an adder 126. 

Before input of frame-by-frame input images, a value 0 is set in all addresses in 

20 the line memory 128. Subsequently, line data on the first line (uppermost portion) of an 
input image is stored in the line memory 120. The arithmetic device 122 subtracts, 
from image data f(t) stored in the line memory 120, image data g(t - 1) stored in the line 
memory 128 at the corresponding address one-line before, thereby obtains a difference 
value d and outputs the difference value d to the LUT 124. 

25 In the LUT 124, values (k x d) obtained by multiplying all difference values d 

(e.g., d = -4095, 4095) by a filter coefficient k dependent on the input value in the 
edge-preservation-type recursive filter 12 are stored in advance. The LUT 124 reads 
out the table value (k x d) corresponding to the input difference value d and outputs the 
table value to the adder 126. Another input to the adder 126 is image data g(t - 1) 

30 output from the line memory 128. The adder 126 adds together these two inputs and 
outputs the sum value as image data g(t) representing an unsharpened image. This 
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image data g(t) is also stored in the line memory 128 and is output from the line memory 
128 as one-line delayed image data g(t - 1). 

The function of the above-described edge-preservation-type recursive filter 12 is 
expressed by the following equation: 
5 g(t) = kd + g(t-l) 

= k{f(t)-g(t-l)} + g(t-l) 
= k.f(t) + (l-k).g(t-l) ...(1) 
In the above equation (1), (1 - k) represents a feedback rate. If the feedback rate 
is higher (k is closer to 0), the degree of smoothing is increased. If the feedback rate is 
10 lower (k is closer to 1), the degree of smoothing is decreased. When k = 1, the 

edge-preservation- type recursive filter 12 immediately outputs the input value without 
performing smoothing. 

Figure 3 shows an example of the LUT 124. When the difference value d is 
small (in the case of a non-edge portion), the gradient from the origin (= filter 
15 coefficient) k is set to a small value (e.g., k = 1/64). When the difference value d is 
large (in the case of an edge), the gradient k is set to a large value (e.g., k = 1). 

The output from the above-described edge-preservation-type recursive filter 12 is 
input to the LUT 14 shown in Figure 1. In the LUT 14, a low-frequency component 
compression characteristic according to low-frequency components of the input image 
20 can be set. The LUT 14 may have, for example, an input-output characteristic of y = ax 
(x: input; y: output; low-frequency component compression rate a = 0.2). By 
various setting means comprising input means such as a mouse and keyboard known as 
input means for computer systems, the input image on a display unit and a compression 
characteristic input menu are displayed on a display unit to enable input of a region of 
25 interest and various values such as numeric values. 

As low-frequency component compression amount setting means, a bit-shift 
arithmetic device for example may be used as well as the above-described LUT 14. The 
extent of bit shift in such a case may be set to about two bits (a =1/4). 

The output from the LUT 14 is input to the arithmetic unit 18. Another input to 
30 the arithmetic unit 18 is the input image supplied via the delay circuit 16. The delay 

circuit 16 is a circuit for coincidence with respect to time between a particular one of the 
pixels of the input image and the corresponding one of the pixels of the unsharpened 
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image. The delay circuit 16 delays the input image by the length of time corresponding 
to the delay caused by the line memory 120 and so on of the edge-preservation-type 
recursive filter 12. 

The arithmetic unit 18 subtracts the output image (unsharpened image) of the 
5 LUT 14 from the input image and outputs an image in which the low-frequency 

components of the input image are compressed. The output image output from the 
arithmetic unit 18 in the form of a digital signal is converted into an analog signal by a 
D/A converter not shown in the figures, and the resulting image is displayed on a 
monitor such as a CRT or a liquid crystal monitor. 

10 As a result of the above-described dynamic range compression processing, if the 

input image has, for example, 4096 levels of gray, the output image has about 3277 
levels of gray (= 4095 (1 - 0.2) + 1). Thus, low-frequency components are largely 
compressed in a pulmonary region in an X-ray fluoroscopic image where halation can 
easily occur. Consequently, halation is reduced and contrast for travel of a catheter, 

15 blood vessels, etc. is improved. 

Figure 4 is an essential-portion block diagram showing another embodiment of the 
image processing device in accordance with the present invention. Portions in this 
embodiment identical to those in the image processing device 10 shown in Figure 1 are 
indicated by the same reference characters and detailed description for them will be 

20 omitted. 

The image processing device 100 shown in Figure 4 is constituted by three 
edge-preservation-type recursive filters 12-1, 12-2, and 12-3, an averaging unit 13, a 
LUT 14, a delay circuit 16 and an arithmetic unit 18. 

Three edge-preservation-type recursive filters 12-1, 12-2, and 12-3 output 
25 smoothed unsharpened images while respectively preserving edges in a 45° direction 
(left-downward direction), a 90° direction (downward direction) and a 135° direction 
(right-downward direction) with respect to the input image. Figure 5 shows an example 
of a configuration of the edge-preservation-type recursive filters 12-1, 12-2, and 12-3. 
The example of the configuration shown in Figure 5 differs from the example of 
30 the configuration shown in Figure 2 in that a line-data-shift arithmetic unit 127 is 

provided. In other respects, the configuration is the same as that shown in Figure 2. 
Detailed description for the same points will be omitted. 
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Referring to Figure 5, the line-data-shift arithmetic unit 127 shifts line data 
according to a shift amount p. A shift amount p= -1 is fixedly set in the line-data-shift 
arithmetic unit 127 of the 45°-direction edge-preservation-type recursive filter 12-1. 

The line-data-shift arithmetic unit 127 of the 45°-direction edge-preservation-type 
5 recursive filter 12-1 stores in the line memory 128 line data obtained by one-pixel 
shifting leftward the line data (unsharpened image) output from the adder 126, and 
exceptionally stores 0 for the rightmost pixel in one line. Thus, the line data output 
from the 45°-direction edge-preservation-type recursive filter 12-1 is obtained as an 
output of smoothing in the 45° direction. 

10 A shift amount p= 0 is fixedly set in the line-data-shift arithmetic unit 127 of the 

90°-direction edge-preservation-type recursive filter 12-2. In this case, the 
line-data-shift arithmetic unit 127 of the edge-preservation-type recursive filter 12-2 
stores the output from the adder 126 in the line memory 128 without shifting. Thus, the 
line data output from the 90° -direction edge-preservation-type recursive filter 12-2 is 

15 obtained as an output of smoothing in the 90° direction. The edge-preservation-type 
recursive filter 12-2 may be formed without the line-data-shift arithmetic unit 127, as 
shown in Figure 2. 

A shift amount p= 1 is fixedly set in the line-data-shift arithmetic unit 127 of the 
135°-direction edge-preservation-type recursive filter 12-3. The line-data-shift 

20 arithmetic unit 127 of the 135°-direction edge-preservation-type recursive filter 12-3 

stores in the line memory 128 line data obtained by one-pixel shifting rightward the line 
data (unsharpened image) output from the adder 126, and exceptionally stores 0 for the 
leftmost pixel in one line. Thus, the line data output from the 135°-direction 
edge-preservation-type recursive filter 12-3 is obtained as an output of smoothing in the 

25 135° direction. 

The output images in the respective directions from the above-described 
edge-preservation-type recursive filters 12-1, 12-2, and 12-3 for filtering in three 
directions are output to the averaging unit 13, and average values are computed in the 
averaging unit 13. The averaging unit 13 may perform weighting averaging by 

30 weighting the output values from the edge-preservation-type recursive filters 12-1, 12-2, 
and 12-3 for filtering in three directions and thereafter performing averaging for 
obtaining arithmetic means. For example, the output images from the 
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edge-preservation-type recursive filters 12-1, 12-2, and 12-3 for filtering in three 
directions may be combined by setting the weight for the edge-preservation-type 
recursive filter 12-2 to 2 and each of the weights for the edge-preservation-type recursive 
filters 12-1 and 12-3 to 3 and obtaining a combination of the addition of the output 
5 values therefrom and bit shift (three-bit shift). 

The effects of the image processing device according to the present invention will 
next be described with reference to Figures 6 and 7. 

Figure 6 is a graph showing profiles of an input image, an image DRC processed 
by using the edge-preservation-type recursive filters for filtering in three directions, and 
10 an image DRC processed by using a recursive filters for filtering in three directions (not 
of the edge preservation type). 

In the case of DRC processing using the non-edge-preservation-type recursive 
filters, low-frequency components are excessively subtracted in an edge neighborhood 
region with respect to the recursive filter processing directions due to phase distortion on 
15 the input image, resulting in occurrence of a black region in the DRC processed image 
(pixel value P = 0). In contrast, DRC processing using the edge-preservation-type 
recursive filters for filtering in three directions according to the present invention ensures 
a reduction in black region in an edge neighborhood region. 

Also, as shown in Figure 7, contrast C2 of the image DRC processed by using the 
20 edge-preservation-type recursive filters for filtering in three directions is substantially the 
same as contrast C3 of the image DRC processed by using the 

non-edge-preservation-type recursive filters for filtering in three directions, and contrast 
CI of a catheter in the input image can be improved. 

That is, contrast at medium-to-fine details of an image such as a catheter and 
25 blood vessels as well as a guide wire in the case of the conventional art can be improved 
by DRC processing using edge-preservation-type recursive filters for filtering in a 
plurality of directions, while limiting black region. 

Industrial Applicability 
30 According to the present invention, as described above, the delay due to image 

processing is short; the amount of computation is small; an artifact such as black region 



is not caused in a processed image; contact for a medium-to-fine detail of an image such 
as a catheter can be largely improved. 
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